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An improved method is provided for determining when 
a set of multivariate data (such as a chromatogram or a spec- 
trum) is an outlier. The method involves using a procedure 
such as Principal Component Analysis to create a model de- 
scribing a calibration set of spectra or chromatograms which 
is known to be normal, and to create residuals describing the 
portion of a particular spectrum or chromatogram which is 
not described by the model. The improvement comprises using 
an average residual spectrum calculated for the calibration set, 
rather than the origin of the model as a reference point for 
comparing a s pea rum or chromatogram obtained from an un- 
known sample. The present invention also includes separating 
a complex set of data into various sub-parts such as sub-chro- 
matograms or sub-spectra, so that outliers in any sub-part can 
be more readily detected. In one particular embodiment, the 
invention is directed towards a method for dividing a chromat- 
ogram into the sub-parts of peak information, baseline shape, 
baseline offset, and noise. 
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IMPROVED METHOD FOR INTERPRETING COMPLEX DATA AND DETECTING ABNORMAL 

INSTRUMENT OR PROCESS BEHAVIOR 
This invention relates to a method of analyzing multivariate data generated by an 
instrument in order to determine whether abnormal features are present. More particularly, 
5 this invention relates to an improved method for rapidly identifying instrumentation or process 
failures in a chemical system. 

On-line analytical instrumentation generates data that is used in a wide variety of 
applications, such as closed-loop control of a process, quality assurance of a product, or 
environmental and safety functions. Often, this data is in the form of multivariate data such as 
1 0 absorbance readings at various wavelengths, a detector response at various times, or any other 
set of data that consists of multiple measured values on each individual sample. The reliability 
of the data depends largely upon the performance of the instrument used to generate the 
data. If the instrument fails to work properly, the data generated may contain little if any valid 
information. 

15 Problems with analytical instruments are often first detected when an individual 

notices that unusual data is being generated. Unexpected peaks, larger than expected noise 
levels, and baseline offsets are just a few of the features that may lead the individual to 
question the validity of a chromatogram or spectrum. Monitoring the data as it is generated 
forthe appearance of these unusual features allows for the detection of developing problems 

20 before they become severe enough to affect the ongoing analysis. Individuals monitoring the 
raw chromatogram or spectrum data perform the largely unconscious activity of learning from 
experience what a "normal" set of data looks like and then deciding whether the present set of 
data is reasonably similar. Unfortunately, it is not practical to manually monitor all of the data, 
as many on-line instruments produce more than a thousand sets of data per day. 

25 Repetitive manual tasks, such as monitoring large amounts of produced data, are 

generally capable of being automated through the use of computers. Furthermore, computers 
are widely used to col lea the data generated by on-line instruments, and so are readily 
available to perform routine monitoring. Unlike an analyst, however, computers cannot 
perform any "unconscious" activity. Accordingly, in order to monitor the data for abnormal 

30 features, the computer must first be programmed to identify normal features in a spectrum or 
chromatogram. 

The field of study that deals with teaching the computer to emulate the process 
of learning and recognizing features in data is called pattern recognition. Pattern recognition 
techniques are typically used to sort sets of data into groups having similar features. In outlier 
35 identification, however, only one group is identified which is defined by the features in a set of 
data containing only sets of multivariate data which are known to be normal. 

Outlier identification is accomplished by first teaching the c mputer to rec gntze 
"n rmal", "acceptable" or "expected" features in multivariate data known t be normal. 
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When a new spectrum orchromatogram is obtained, its features are compared to what is 
expected. If the data has additional features, or lacks significant features, it is labelled 
"abnormal", "unacceptable", or an "outlier". Outliers may be the result of many different 
causes such as instrument failures, mechanical problems or process problems such as impurities 

5 in the analyzed materials. Pattern recognition techniques are able to identify any changes in 
the appearance of the data, regardless of its source, whereas simpler systems which are 
programmed to signal the operator whenever certain unwanted values are reached, can only 
be used to detect foreseen problems. Accordingly, when pattern recognition techniques are 
used, the potential for abnormalities in the data being undetected is reduced. 

10 Principal Component Analysis (PCA) is one procedure that can be used as a 

pattern recognition technique, PCA will be used below to illustrate the invention, but it should 
be understood that the present invention can be used with any technique which can model 
features in the data (e.g. Partial Least Squares technique - see P. Geladi, and B.R. Kowalski, 
Analytica Chemica Acta, 185, pg. 1, 1986). 

1 5 One way of describing how PCA works is to think of PCA reorienting a set of data 

so that each spectrum orchromatogram becomes a single point in a multidimensional space. 
The number of measurements which make up the original spectrum or chromatogram defines 
the number of dimensions in the new coordinate system. A group of calibration 
chromatograms or spectra which the analyst has determined to be representative of the 

20 expected spectra or chromatograms can be placed in this coordinate system forming a cloud of 
points in the multidimensional space. PCA mathematically describes this cloud of points using 
as few dimensions (or principal components) as possible. Residual sets of multivariate data 
(residuals) which identify the portion of each calibration spectrum or chromatogram which was 
not contained within the model are then calculated. The sum of the squares (SS) of the 

25 residuals are then compared with the SS of the residuals obtained for unknown samples to see 
if the unknown samples are within the proper range. 

The current uses of the PCA method for outlier detection are only concerned with 
the SS of the residual spectra (see Gerd Puchwein and Anton Eibelhuber, "Outlier Detection in 
Routine Analysis of Agricultural Grain Products by Near-Infrared Spectroscopy", Analytica 

30 Chemica Acta, 223, pp. 95-103, 1989). This is analogous to using the square of the Euclidean 
distance of the residual spectrum from the origin. Theoretically, the PCA model could be 
constructed to take into account all features of the calibration set. This would result in residual 
spectra randomly distributed about the origin as the residual spectra would only contain 
random noise. In this situation the SS of the residual spectra is an appropriate measure of 

35 normality. Experience has shown, however, that when more principal components are added 
to the model in order t describe every feature in th calibration chromatograms or spectra, 
the model becomes too close a fit of the caiibrati n set data; the model beg ins to fit the noise 
in the data (overfitting). When this happens, the unknown samples which should be classified 
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allow flexibility, a leave-one-out cross-validation technique can be used. This process operates 
by removing one of the members of the calibration set, recalculating the model, and then 
treating the removed calibration set member as an unknown. If this results in a t-distance 
greater than preselected value (e.g three if the t-di stances are assumed to be approximately 
5 normally distributed), then either the spectrum was incorrectly chosen as a calibration set 
member or the model is too precise and a principal component should be removed. This 

« 

process is repeated for each of the members of the calibration set until all of them produce t- 
distancesof less than the preselected value when they are "left-out" of the calibration set and 
treated as an unknown. 

10 Once the model has been shown to accurately represent the calibration spectra 

while allowing enough flexibility, then unknown samples can be evaluated. The procedure is 
similar to the treatment of the calibration spectra. First, the spectrum is represented by a point 
in the multidimensional space. Then the point is projected onto the model and a residual 
spectrum is obtained. Next the Euclidian distance between the residual spectrum for the 

15 sample and the average residual from the calibration set is measured, and a t-distance 

calculated. Any unknown sample whose residual spectrum has a t-distance greater than the 
preselected value or is otherwise deemed abnormal using other control chart criteria would be 
considered an outlier, and the operator would be promptly notified. 

This system was tested using data gathered from a gas chromatograph. tt was 

20 soon discovered that in gas chromatography certain elements change over a period of time. 
Thus, new models had to be constructed frequently to take into account the changing 
circumstances. As this is very inconvenient as well as wasteful, an alternative was sought. 

tt was discovered that the chromatograms could be broken up into separate sub- 
parts (sub-chromatograms), and that each of these sub-chromatograms could be individually 

25 modeled using a technique such as PCA. A chromatogram can be thought of as a f unction of 
time F(t), which can be written as the sum of a series of separate functions containing unique 
information. For example, a chromatogram can be represented as the sum of the baseline 
offset, the baseline shape, the peak information, and the typically higher frequency noise. 
Evaluating each of these sub-chromatograms separately results in a more sensitive analysis, and 

30 the analyst can see which component of the chromatogram is abnormal. Accordingly, if the 
baseline shape changes overtime, the analyst will be made aware of the change, but will know 
that valid peak information is still being generated. 

A method was developed to separate out the various sub-parts from a set of 
multivariate data. This allows for a more sensitive analysis, and the identification of the source 

35 of the variation. As seen in the flowchart of FIG. 1 , this method comprises first identifying the 
portions of the multivariate data which contain peak information. The portions so identified 
are then subtracted from th set of multivariate data. These removed porti ns are then 
replaced using linear interpolation or some other method to appr ximate what the baseline 
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would have been withoutthe peaks. Finally, this approximation of the has line is subtracted 
from the unaltered set of multivariate data, thereby forming a set of data containing peak 
information. 

The peak information can be subtracted from the unaltered set of multivariate 
5 data to form a set of data containing baseline shape. Noise and the baseline offset can be 
removed from this set of data to provide greater separation. Thus, it is possible to separate a 
set of multivariate data into peak information, baseline shape, baseline offset and noise. 
Furthermore these can be combined in anyway depending on the needs of a particular 
analysis. 

10 A preferred embodiment of accomplishing the method for a chromatogram is set 

out in the fol lowing paragraphs for exemplary purposes. It should be understood, however, 
that the following is only one way of accomplishing the method and that each individual step 
may be accomplished by other equivalent methods known in the art (e.g. a cubic spline fit can 
be used to obtain the second derivative, or smoothing techniques can be used to remove the 

1 5 noise). Furthermore, the preferred embodiment described below contains specific parameters 
for exemplary purposes only. These parameters were used to adequately separate the 
chromatogram shown in FIG 2 into sub-chromatograms as seen in FIGS. 3-6. Practitioners in the 
art will understand that these parameters can be varied to suit the needs of the individual 
analysis. 

20 Fir st# the second derivative of the chromatogram was calculated. The second 

derivative was obtained using the Savitsky-Golay method (Abraham Savitsky, Marcel Golay, 
Analytical Chemistry, 36, No. 8, pg. 1627 July, 1964), with a moving window for the second 
derivative containing 31 points (parameter 1 ). Next, it was determined that the first fifty points 
(parameter 2) contained no peak information and that this region was typical of the noise and 

25 baseline offsetseen in the whole chromatogram. The average and standard deviation of the 
values of the points in this region were then calculated. The entire second derivative was then 
examined and any point which had a value greater than three standard deviations (parameter 
3) away from the average value of the first fifty points was assumed to contain peak 
information. Furthermore, to be sure that the rising and falling edges of the peaks, as well as 

30 the points of inflection, were not considered baseline points, the ten points (parameter 4) 
before and after each point identified as a peak were also defined to be part of that peak. 

Once the location of the peaks had been determined, the peaks were removed 
from the original chromatogram leaving blank regions. These regions were filled in using a 
linear interpolation of the points which framed the region. This resulted in a first 

35 approximation of the baseline. This first approximation of the baseline was then subtracted 
fr m the original chromat gram leaving only peak information. The peak information was 
then smoothed using a Savitsky-Golay smooth with a moving window of 1 1 p ints (parameter 
5). This resulted in the peak sub-chr matogram (FIG. 3). 

-8- 
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as normal will be classified as outliers because their noise structure will not be identical to the 
noise structure of the members of the calibration set. Therefore, a better approach would be 
to use fewer principal components in the modeling, and allow relatively small features to 
remain in the residual spectra. In this situation the residual spectra are not distributed about 

5 the origin, and therefore, the SS of the residual spectra is no longer an appropriate measure of 
the acceptableness of the spectra. To take into account the location of the residual spectra 
relative to the origin, the average of the residual spectra is used as a reference point rather 
than the origin. Consequently, this approach avoids overf itting by reducing the number of 
principal components and increases the sensitivity for detecting abnormal features or outliers 

! 0 by using the average residual spectrum as a reference point. 

Furthermore, the PCA method cited above has been applied only to near infrared 
spectra. Further difficulties are encountered when expanding the known pattern recognition 
techniques to chromatographic applications, in chromatographic applications, some features 
of tne data are expected to change overtime. For example in gas chromatography, as the 

1 5 column ages, changes in the baseline become more prevalent. If the baseline offset or shape 
changes, all of the data being produced will be labelled outliers, even though valid peak data is 
being generated. 

It is an object of the present invention to provide a method which is more 
sensitive than known methods for determining when a spectrum is an outlier. 

20 Another object of this invention is to provide a sensitive method for determining 

outliers which can be used for any form of multivariate data. 

Still another object of this invention is to provide a method for separating a set of 
multivariate data into various sub-parts, so that each sub-part may be evaluated separately, 
thereby increasing the sensitivity of an analysis such as outlier detection 

25 The present invention is directed to an improved method for detecting outliers in 

a system which collects sets of multivariate data such as chromatograms or spectra. The 
method involves using a procedure such as Principal Component Analysis to create a model 
describing a calibration set of spectra or chromatograms which is known to be normal, and to 
create residuals describing the portion of a particular spectrum or chromatogram which is not 

30 described by the model. The improvement comprises using an average residual calculated for 
the calibration set, rather than the origin of the model as a reference point for comparing a 
spectrum or chromatogram obtained from an unknown sample. This improvement allows 
increased sensitivity towards detecting outliers. 

The present invention is also directed to separating a complex set of data into 

35 various sub-parts such as sub-chromatograms or sub-spectra, in one particular embodiment, 
the invention is directed towards a method for dividing a chromat gram into the sub-parts f 
peak information, bas line shape, bas line offset, and noise. Dividing a set of multivariate 

-3- 
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data in this way allows the detection of outliers to be more sensitive to changes in one or more 
of the sub-parts. 

The invention is also directed towards an improved method for carrying out an 
automated chemical reaction. The method incorporates the method for detecting outliers as a 
5 way of checking for changes in the feedstock, chemical process and instruments. If any of these 
items fails, multivariate data produced in the course of the process will reflect the failure. The 
current invention allows these changes to be automatically detected as soon as they occur. 

Additional advantages and features of the present invention will become 
apparent from a reading of the detailed description of the preferred embodiment which 
10 makes reference to the following set of drawings in which: 

Figure 1 is a flow chart of a preferred embodiment of the method for separating a 
set of multivariate data into sub-parts, illustrating how a chromatogram can be broken up into 
the sub-chromatogramsof peak information, baseline shape, baseline offset, and noise- 
Figure 2 is a copy of an unaltered chromatogram used to demonstrate how such a 
1 5 chromatogram can be broken up into separate sub-chromatograms; 

Figure 3 is the peak information sub-chromatogram, which has been separated 
from the unaltered chromatogram in Figure 2 according to the present invention; 

Figure 4 shows the chromatogram remaining after removing the peak 
information shown in Figure 3 from the unaltered chromatogram of Figure 2, so that the noise 
20 and baseline shape may be determined; 

Figure 5 is the noise obtained from the chromatogram in Figure 4, separated 
according to the present invention; and 

Figure 6 is the baseline information obtained by removing the noise and baseline 
offset from the chromatogram in Figure 4. 
25 It should be understood thatthe method of this invention can be applied to any 

set of multivariate data capable of being measured such as chromatograms or spectra. For 
purposes of this discussion, however, it will be assumed thatthe data being analyzed is a 
spectrum consisting of absorbance data at various wavelengths. 

According to the method of the invention, the first step is collecting a set of 
30 representative multivariate data. Thisset of data will be used to teach the computer what 
features are contained in "normal" spectra or chromatograms. Therefore, the spectra should 
be manually selected to ensure that they are representative of the type of spectra expected to 
be obtained. 

Once a calibration set of data has been chosen, a procedure such as principal 
35 component analysis (PCA) is used to construct a model describing the data. The following 

discussion is meant to help visualize how PCA perates. Traditionally, a spectrum c nststing f 
absorbance readings at a large number (e.g. 300) of wavelengths is represented as a f uncti n 
wherein the ordinate is th level of absorbance while the abscissa is divided up into 

-4- 
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wavelengths. Thus, for every wavelength tnere is an absorbance point. In PCA each spectrum 
or chromatogram can be thought of as being represented as a single point in a 
multidimensional axes system. A spectrum consisting of data at 300 wavelengths, for example, 
would be represented as a single point in a 300 dimensional space. Accordingly, the number of 

9 

5 dimensions needed is equal to the number of absorbance data points in the traditional system. 

Each member of the calibration set is plotted in the same multidimensional space, 
creating a cloud of points, each point representing one spectrum. The more similar the original 
spectra were, the tighter the cloud will be. This cloud can be exactly described using at most r 
principal components, where r is determined by the lesser of the number of dimensions in the 

10 multidimensional space, and the number of points making up the cloud. Much of the 
variability of the cloud can be described using many fewer principal components, as the 
original spectra are largely similar. PCA is used to create a model describing the cloud of points 
using as few principal components as possible, while still ensuring that a targe percentage of 
the cloud is described. This percentage can be varied depending on the analyst's needs. 

15 PCA modeling has been more completely described by G. H. Goluband C. F. Van 

Loan in Matrix Computations, John Hopkins University Press, 1983, and by J. E. Jackson in 
Journal of Quality Technology, 1980, vol. 12. pg 201. These references disclose that ina given 
matrix X, consisting of m rows of samples, and n columns of wavelengths, so that each point in 
the matrix is filled with an absorbance reading of the indicated sample at the indicated 

20 wavelength, the PCA model is described by the following equations: 

X s USV 

where U is an mxr matrix of eigenvectors for the matrix XX*; S is an rxr diagonal matrix 
containing singular values; V is an rxn matrix of eigenvectors for the matrix X'X; and r is the 
rank of the matrix X. V is an orthonormal matrix (i.e. V'V = I), therefore this equation can be 
25 rearranged as follows: 

XV s us 

The eigenvectors in V describe the orientation of the principal component hyperplane in the 
wavelength space that contains the calibration samples. The product of the matrices U and S 
forms a matrix called the score matrix. This matrix contains the projections of the spectra on 

30 the new coordinate system defined by the eigenvectors. The rank, r, defines the dimensionality 
of the space required to contain all of the points in the space. For the purposes of this 
invention, the number of eigenvectors and the dimensionality of the PCA model will always be 
less than the full rank of X. This means that there will always be a finite residual spectrum that 
was not described by the PCA model. These residual spectra can be obtained using the 

35 following formula: 

Resid = X(l-V k V k ') 
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where Resid is an mxn matrix of residual spectra; X is the mxn matrix of original spectra; I is an 
nxn identity matrix; and Vk is an nxk matrix containing the first k columns of V (where k is less 
than rand kdefines the dimensionality of the PCA model). 

To use the residuals to identify outliers, a system was developed to characterize 

5 the calibration residual spectra. As previously discussed, it should be understood that the 

present description uses "spectrum" for ease of discussion only and that any set of multivariate 
data capable of being measured is amenable to the technique. 

The first step is to calculate the average calibration residual spectrum, which is the 
spectrum formed by averaging the absorption values at each wavelength for all calibration 

10 residual spectra. The Euclidian distance of each calibration residual spectrum from the average 
calibration residual spectrum was then calculated. Any sample having a residual (calculated as 
described above) whose Euclidean distance from the average residual is statistically different 
from the group of Euclidean distances obtained for the calibration set can be labeled an 
outlier. "Statistically different" as used herein includes any situation where a sample (or a 

15 series of samples) produces a Euclidean distance which would not be expected given the 

variances observed in the calibration set. Although several methods are known for making the 
determination of whether a single value (or a trend of consecutive values) is statistically 
different from a group of values, the following method is preferred. This method is presented 
for exemplary purposes only, however, and should not be viewed as limiting the invention to 

20 this particular method. 

First, the average of the distance between the residual for each calibration set 
member and the average calibration residual is calculated. Next the standard deviation for 
these distances is obtained. Once the average and standard deviation are known for the 
calibration set, a value herein termed the "t-distance" can be calculated for each member of 

25 the calibration set according to the following formula : 

DISj - AVE 

t-distance; =■ 

STD 

where Diss is the distance of the ith residual spectrum from the average residual spectrum; and 
AVE and STD are the average and the standard deviation of the distances of the calibration set 

30 members from the average residual spectrum. In this way r a residual spectrum is characterized 
by a single value and control chart techniques can be used to classify a spectrum as an outlier. 

With enough principal components in the PCA model, all of the variation in the 
calibration set could be exactly described. A model which exactly described the calibration set 
would not help determine whether a new spectrum is an outlier, however, as if the new 

35 spectrum had a noise structure different from the calibration set then it would be labelled an 
outlier, regardless f other similarities. To determine the number jf grjncipal components to 
include thereby ensuring that the PCA model contains few enough principal components to 

-6- 



WO 93/21592 



PCT/US93/03635 



1 . In a method for examining multivariate data to determine outliers, of the 
type in which a procedure is used to create a model of a calibration set and to create residuals 
describing the portion of each member of the calibration set which is not described by the 
model, the improvement comprising: 

5 (a) creating an average residual by averaging the residuals of all of the 

calibration set members; 

(b) determining the distance between the residual for each member of the 
calibration set and the average residual; 

(c) determining the distance between a residual obtained from an 
10 unknown sample and the average residual; 

(d) labeling as an outlier any sample whose distance obtained in step (c) is 
statistically different from the set of distances determined in step (b). 

2. The method of Claim 1 wherein the procedure used to create the model of the 
calibration set is Principal Component Analysis. 

15 3. The method of Claim 1 wherein the multivariate data is separated into a 

plurality of sub-parts prior to creating a model so that an outlier in one or more selected sub- 
parts can be detected. 

4. The method of Claim 3 wherein at least one of the sub-parts includes a 
member of the group consisting of peak information, baseline shape, baseline offset and 

20 noise. 

5. The method of Claim 4 wherein one of the sub-parts includes peak 
information, separated by a method which comprises the following steps: 

(a) obtaining a set of multivariate data which includes peak information; 

(b) identifying the portions of the multivariate data which contain peak 
25 information; 

(c) subtracting the portions identified in step (b) from the set of 
multivariate data obtained in step (a); 

(d) replacing the points subtracted in step (c) from the set of multivariate 
data obtained in step (a), so that a first approximation of the baseline is formed; 

30 and 

(e) subtracting the first approximation of the baseline formed in step (d) 
from the set of multivariate data obtained in step (a), thereby forming a set of 
data containing peak information. 

6. The method of Claim 5 wherein step (e) further comprises smoothing out the 
35 peak information data. 

7. The method of Claim 6 wherein a second sub-part includes baseline shape, 
separated by a method which comprises: 
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(f) subtracting the set of data formed in step (e) from the set of 
multivariate data obtained in step (a), thereby forming a set of data containing 
baseline shape. 

8- The method of Claim 7 wherein a third sub-part includes noise separated by a 
5 method which comprises: 

(g) subjecting the set of data formed in step (f) to a Fourier transformation 
and then a filtering operation; and 

(h) subtracting the set of data formed in step (g) from the set of data 
formed in step (f) thereby forming a set of data containing noise information. 

10 9 * Tne method of Claim 8 wherein a fourth sub-part includes the baseline offset 

which is defined as being the least positive point in the set of multivariate data obtained in step 
(a). 

10. The method of Claim 5 wherein step (b) comprises: 

calculating the val ues for the second derivative of the set of multivariate 
15 data obtained in step (a); 

selecting a region in the set of multivariate data which is known not to 
contain peaks; 

averaging the values for the second derivative of the points in the region; 

calculating a standard deviation for the values for the second derivative of 
20 the points in the region; and 

defining any point whose second derivative is further than a preselected 
number of standard deviations from the average value forthe second derivative 
in the region to be part of a peak. 

11. The method of Claim 10 further comprising defining any point within a 
25 preselected number of points from a point defined as a peak in Claim 9 to be part of a peak. 

12. The method of Claim 5 wherein step (d) includes using linear interpolation to 
replace the points subtracted in step (c). 

13. The method of Claim 7 wherein step (f) further comprises: 

defining the basel me offset to be the least positive point in the set of data 
30 formed in step (d); 

subtracting the baseline offset from the set of data containing baseline 
shape; and 

subjecting the resulting set of data to a Fourier transformation and then a 
filtering operation. 

35 14. A method for examining multivariate data to determine outliers, comprising 

the steps of: 

(a) selecting a calibration set of multivariate data; 
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The peak sub-chromatogram was then subtracted from the original 
chromatogram. This left a sub-chromatogram (hereinafter referred to as sub-chromatogram 
A) containing the baseline shape, the baseline offset and noise (FIG. 4). Sub-chromatogram A 
was then subjected to a Fourier transformation, and the resultant interferogram was subjected 

5 to a boxcar filter. The boxcar filter used zeros for all Fourier coefficients above coefficient 101 
(parameter 6). After filtering, an inverse Fourier transformation was performed. This resulted 
in a sub-chromatogram (sub-chromatogram B) which contained only the baseline shape and 
baseline offset Sub-chromatogram B was subtracted from sub-chromatogram A yielding the 
noise sub-chromatogram (FIG. 5). The least positive point in sub-chromatogram B was defined 

10 as the baseline offset and was subtracted from sub-chromatogram B yielding the baseline 
shape sub-chromatogram (FIG. 6). 

Any combination of the three sub-chromatograms (peak, noise and baseline 
shape) and the offset can be used to form a new sub-chromatogram if the separation into four 
parts is not appropriate. 

15 Any resulting sub-chromatogram containing baseline shape and/or peak 

information can be evaluated using the PCA modeling method previously discussed. The offset 
value by itself is not multivariate and is therefore not amenable to PCA model ing. Standard 
control chart techniques can be used to monitor the offset. Similarly, a sub-chromatogram 
containing only noise or noise with the baseline offset should contain only random variation 

20 and consequently is not suited to PCA modeling. Control chart techniques can be used to 
monitor various statistics (e.g. maximum value, minimum value, standard deviation, sum of 
absolute values, and mean value) of these sub-chromatograms in order to detect outliers. 

Accordingly, a spectrum or chromatogram can be broken up into sub-parts such 
as peak information, noise, baseline offset, and baseline shape. Each of the sub-parts can be 

25 monitored to see if it is within the normal range expected for the analysis. In this way the 
observer can tell which type of feature in the multivariate data is abnormal. Furthermore, 
dividing up the multivariate data makes the analysis more sensitive. For example, in 
chromatography if the baseline offset drifts from run to run, then the cloud of points in the 
multidimensional space will necessarily be more spread out, reflecting the fart that identical 

30 samples could have different responses at a particular time after sample injection depending 
on the baseline offset. Spreading out the cloud of points may hide some slight variation which 
has occurred in some other feature in the chromatogram for which little variation is expected. 
Consequently, separating the data into various sub-chromatograms allows the system to 
confidently classify as outliers, samples with slight variations in a sub-chromatogram for which 

35 there should be little or no variation. 

This technique can be placed on-line in a chemical process, furthering the 
aut mation of such processes. A computing device can be programmed to make the necessary 
calculations described above. This computing d vice can then evaluate the chromatograms or 
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spectra which are routinely generated forsamples of chemical processes. When an outlier is 
detected, the computing means can signal an operator and/or shut down the process, so that 
no resources are wasted producing material which does not meet the required specifications. 

It will be appreciated that the above disclosed embodiments are suited to achieve 
5 the aforementioned objectives of the present invention. In addition, it is evident that those 
skilled in the art, once given the benefit of the foregoing disclosure, may make modifications 
of the specific embodiments described above without departing from the spirit of the 
invention. Such modifications are to be considered within the scope of the present invention 
which is limited solely by the scope and spirit of the appended claims. 
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(b) representing each member of the calibration set as a single point in a 
multidimensional axes system; 

(c) constructing a model describing the points of step (b); 

(d) obtaining a residual for each member of the calibration set by 

5 calculating the portion of each member which is not depicted by the model 

constructed in step (c); 

(e) creating an average residual by averaging the residuals of all of the 
calibration set members; 

(f) determining the distance between each of the residuals obtained in 
1 o step (d) and the average residual obtained in step (e); 

(g) determining the average and standard deviation of the distances 
obtained in step (f); 

(h) calculating a t-distance for each member of the calibration set 
according to the formula : 



15 



20 



25 



DlSj - AVE 

t-distancej = • 



STD 

where Dis, is the distance obtained in step (f) for any member i, and AVE and STD 
are the average and standard deviation values obtained in step (g); 
(i) acquiring a set of multivariate data from a sample; 
(j) obtaining a residual for the sample by calculating the portion of the 
sample which was not depicted by the model constructed in step (c); 

(k) determining the distance between the residual obtained in step (j) and 
the average residual obtained in step (e); 

(I) calculating a t-distance for the sample according to the formula: 

DISsa m - AVE 

t-distancej = 

STD 

where DiSsa m is the distance obtained in step (k), and AVE and STD are the 
average and standard deviation values obtained in step (g); and 
3 q (m) labeling as an outlier any sample whose t-distance is statistically 

different from the t distances obtained in step (h). 

15. The method of Claim 14 wherein principal Component Analysis is used to 
construct the model in step (c). 

16. A method of separating a set of multivariate data into a plurality of sub-parts, 
35 wh€re ' n eacri sub-part comprises at least one member selected from the group consisting of 

peak informati n, bas line shape, baseline offset, comprising the steps of: 

(a) obtaining a set of multivariate data which includes peak information; 
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(b) identifying the portions of the multivariate data which contain peak 
information; 

(c) subtracting the portions identified in step (b) from the set of 
multivariate data obtained in step (a); 

5 (d) replacing the points subtracted in step (c) from the set of multivariate 

data obtained in step (a), so that a first approximation of the baseline is formed; 
and 

(e) subtracting the first approximation of the baseline formed in step (d) 
from the set of multivariate data obtained in step (a), thereby forming a set of 
10 data comprising peak information. 

17. The method of Claim 16 wherein step (d) includes using linear interpolation 
to replace the points subtracted in step (c). 
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18. The method of Claim 16 further comprising: 

(f) smoothing out the set of data formed in step (e). 

19. The method of Claim 18 further comprising: 

(g) subtracting the set of data formed in step (f) from the set of multivariate 
5 data obtained in step (a), thereby forming a set of data comprising baseline 

shape, noise and baseline offset. 

20. The method of Claim 19 further comprising: 

(h) subjecting the set of data formed in step (g) to a Fourier transformation 
and then a filtering operation; and 

1 0 (<) subtracting the set of data formed in step (h) from the set of data 

formed in step (g) thereby forming a set of data comprising noise. 

21. The method of Claim 20 further comprising: 

(j) defining the baseline offset to be the least positive point in the set of 
multivariate data obtained in step (a). 
1 5 22. The method of Claim 21 further comprising: 

(k) subtracting the baseline offset defined in step (j), and the set of data 
formed in step (i) from the set of data obtained in step (g). 

23. The method of Claim 16 wherein step (b) comprises: 

calculating the values for the second derivative of the set of multivariate 
20 data obtained in step (a); 

selecting a region in the set of multivariate data which is known not to 
contain peaks; 

averaging the values for the second derivative of the points in the region; 

calculating a standard deviation for the values for the second derivative of 
25 th « points in the region; and 

defining any point whose second derivative is further than a preselected 
number of standard deviations from the average value for the second derivative 
in the region to *>e part of a peak. 

24. The method of Claim 23 further comprising defining any point within a 

30 preselected number of points from a point defined as a peak in Claim 23 to be part of a peak. 
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